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ABSTRACT 

This study provides a description of a program 
initiated in 1980 by the Maryland State Education Agency (SEA). The 
School Improvement through Instructional Process (SITIP) program 
presents data for a study involving educators in 19 of 24 local 
education agencies. The SITIP design includes nine areas cf activity: 
(1) SEA preparation; (2) building local commitment; (3) conducting 
awareness training; (4) local planning involving the submission of 
proposals based on SEA guidelines concerning issues to be addressed, 
such as the deciding factors in the selection of schools, curriculum 
areas, and implementation strategies (including the lighthouse school 
strategy and feeder school strategy); (5) implementation ; (6) 
dissemination; (7) SEA technical assistance; (8) followup training by 
SEA staff; and (9) assessment of program and impact. The data are 
examined in terms of participation, participant evaluation of 
activities initiated by the SEA , comparison of initial proposals and 
Promising Educational Practices Submittal plans, and the relationship 
of planning to training and implementation. A figure of the SITIP 
design and a table showing the SITIP chronology of events are 
provided . (PB) 
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Introduction 

This paper discusses planning as an interactive process with other 
activities in relation to a statewide program of instructional improvement. 
The program — School Improvement Through Instructional Process (SITIP) — 
was initiated by the Maryland state educaticm agency (SEA) in late 1980, 
with local implementation beginning in the fall of 1981. Four research- 
based instructional processes were selected: Active Teaching, developed by 
Good and Grouws; Mastery Learning, developed by Bloom and Block; Student 
Team Learning, developed by a team at Johns Hopkins University; and Teaching 
Variables, developed by a team at Research for Better Schools. Educators 
hoped that implementation of one or more of these innovations would improve 
teachers' effectiveness and increase student achievement. 

SITIP is a voluntary program which encourages cross-hierarchical 
participation in all phases; provides support to local education agencies 
(LEAs) in the form of training, assistance, and small grants; and recognizes 
that successful implementation of innovations is influenced by many factors 
— not the least of which is local commitment which is related to a sense 
of ownership generated during planning. From the LEA perspective, the 
literature on planning states that this activity is "context bound" and 
"situationally oriented" (Lotto, et al ., 1980) requiring adaptability that 
reflects political realities and also allows for the flexibility needed at 
the level of implementation (Boyd & Crowson, 1981). This suggests a need 
for open-systems planning. However, many LEAs traditionally develop plans 
with a product orientation, rather than engage in planning with a process 
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orientation. Also, local plans developed in response to SEA initiatives 
may not result in implementation (but only in a lip-service compliance). 
Therefore, Maryland's program, while focusing on the substance of the 
classroom improvement strategies to be adopted, engaged participants in an 
evolving planning process which facilitated the improvement of plans as 
knowledge of the program increased, and which was designed to lead to real 
imp lemen t a t ion . 

Evaluation Design 
By examining the activities of staff of the Maryland SEA and of 
educators in 19 of the 24 LEAs, we attempt to answer the following ques- 
tions: 

• What were the SEA policies and practices influencing LEA planning? 

• How did LEA staff plan? 

• What were the major characteristics of local plans? 

• How did local plans and planning processes change over time? 

• What were the relationships among planning, training and implemen- 
tation? 

Data were collected between December 1980 and June 1982 by process 
observation of SEA meetings and formal SEA- initiated events, site visits to 
schools and district offices, interviews, questionnaires, and a general 
survey. In addition, program materials and all local plans were analyzed 
(original and revised versions); assessment was made of the extent to which 
implementation matched plans; and attendance records were analyzed to 
determine role group participation (sustained over 18 months). Critical 
events included awareness conferences, summer workshops, follow-up seminars, 
and spring and fall planning sessions. 

4 
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Of the 24 counties (LEAs) in Maryland, 19 were involved in the program, all 
of which provided data and eight of which were also involved in site visits 
by the researchers. Data were collected from over 50% of the local educators 
involved. (Total numbers in the program were: nearly 700 teachers, over 
65 school administrators, over 20 central office staff.) 

Qualitative and quantitative data were analyzed by topic, by county, 
and by role group for each key process — training, planning, and implemen- 
tation.* 

Results 

While the focus of this paper is on local planning, it is also necessary 
to review SEA activities since the interaction between the two organizational 
levels (state and local) was highly influential. Therefore, results are 
first presented within the chronological framework of the SITIP design. 
SEA Initiatives and LEA Activities 

The SITIP design is presented in Figure 1. The nine areas of activity 
included six that are fairly common in educational change efforts: 1) SEA 
preparation, 2) building initial local commitment, 3) conducting awareness 
training, 4) local planning, 5) implementation, and 6) dissemination or 
expansion. In addition, SEA staff provided technical assistance (including 
on-site coaching), follow-up training, and assessment of progress and 
impact (conducted by a third party using an action research model to allow 



*For a full report of the complete study, see Roberts, J. M. E. , 
Kenney, J., Buttram, J., & Woolf, B. Instructional improvement in Maryland: 
A study of research in practice . Philadelphia: Research for Better 
Schools, Inc., 1982. (Also submitted to ERIC.) 



MSDE Preparation 
(open-systems planning) 



Initial Commitment 
(of local teams) 



Awareness Conferences 
(content and design 
Information) 



Technical Assistance 
(coaching) 







Local Proposals and Plans 
(with allowance for biannual 
or annual up-dates) 







Follow-up Training 



Assessment of Progress 
and Impact 



Implementation 



Dissemination 
(expansion) 



Figure 1. The SHIP Design: An Interactive Model for Program Improvement 
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for regilar and frequent review of data with appropriate program revisions). 
These activities were interactive , as is illustrated by the chronology of 
events summarized in Table 1. The discussion that follows reviews SEA 
initiatives directly related to local plans and planning, and local 
responses to those initiatives. 

Preparation and commitment . Influenced by the research on planned 
change which indicates the desirability of cross-hierarchical participation 
in planning and implementation, with involvement of members sustained over 
time, the SEA asked LEA superintendents to make certain commitments such 
as: 1) attendance at all four awareness conferences by up to eight persons 
from each LEA including a board member, some central office staff, a princi- 
pal, and teachers from the same school as the principal; 2) submission of a 
local proposal to implement one or more of the innovations if there was 
sufficient local need or interest ; 3) attendance by local team members at 
key events initiated by the SEA to facilitate implementation, once the SEA 
approved support for a local plan ; and 4) actual implementation of the 
innovation as planned (including evaluation), for LEAs choosing to partici- 
pate . 

Of the 24 LEAs, 20 expressed interest in SITIP and sent teams to the 
awareness conferences. Subsequently, 19 submitted proposals and implemented 
selected innovations. 

Request for proposals . Following the four awareness conferences, the 
SEA invited LEAs to submit non-competitive proposals for adoption and 
implementation of one or more of the four instructional processes. Districts 
were provided with proposal development guidelines that contained eight 



Table 1 



SHIP Chronology of Events 
December 1980 - September 1982* 



Activity Area 


SEA Activitias 


LEA Activities 


Dates 


Planning 


Preparation/program design 

Invitation for l.-,cal commitment 


Review, response of commitment 


Juiv - October 1980 

October - November l'-'KO 


Training 


Four awareness conferences 


Attendance of teams at awareness 
conferences 


Decenber 1980 - Feb. 19*1 


i'lann in^ 


((•quest for local proposals 


Submission of proposals (19 LEAk) 


March - April 1 1 


Assessment. 


Analysis of local response to 
conferences and of proposals 




April 19H1 


Planning 


Four spring planning sessions 


Attendance ,it spring planning 
session* 


April - May 1981 


Assessment 


Analysis of local response to 
spring planning sess Ions 




May 1961 


Tra in In**. 


Four sunsner Institutes 


Attendance at institutes 


June - fulv 1981 


Planning 


Fall planning session 


Attendance at session, revision 
of plans 


September - "overtb«-r 1981 


Technical 
Assistance 


Follow-up training sessions 
(1 or 2 per Innovation) plus 
on-site coaching etc. 


Attendance at follow-ups 


Sept. 1981 - .June l^J 


implementation 




Use of one or more innovations 

(19 LEAs) 


Sept. 1)81 - June IVhJ. 


Assessrent 


Analysis of progress to date 


1 

review of findings 


Oct. 19*1, then r^uMv. 
Atcufac 1982 


H latmitw 


Invitation to update or refine 
plans 


Revision of plans (plus Inclusion 
of 5 more LEAs) 


August - ?fcpttrber 1 .**2 



--.i;iP: School Improvement Through Instructional Process. The SEA supports local implementation throuih 
with on-going training, technical assistsnce, and assessment. However, this report relates onlv to act! 
to the beginning of the 1982 school year. 
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issues to be addressed in the local school district submissions: 1) 
deciding factors in selection of schools, 2) deciding factors in selection 
of curriculum areas, 3) deciding factors in selection of implementation 
strategies, 4) evaluation criteria or methods, 5) analysis of Year 1 
implementation tasks, 6) progress monitoring procedures, 7) dissemination 
procedures for Year 1 results, and 8) budget. Proposals were submitted to 
MSDE by 19 districts by mid-April. All districts applying for SITIP funds 
were awarded monies for local projects. 

Twelve of the 19 districts (63.15%) elected to implement only one of 
the four innovations; the remaining seven districts (36.85%) decided on 
combinations of two or three of the innovations. The most selected 
innovations were Teaching Variables (47.37%) and Student Team Learning 
(42.11%). Districts proposed implementation for all curriculum areas with 
a focus on basic skills. Three LEAs proposed implementation only in 
elementary grades, two only in junior high schools, five only in senior 
high schools. The remaining nine LEAs proposed to involve both elementary 
and secondary grades. 

Nine criteria were identified by local school districts as influential 
in their selection of schools. Approximately two-thirds of the districts 
(68.42%) selected schools in which to implement SITIP on the basis of staff 
commitment. A third of the districts (36.84%) considered particular 
features or characteristics of individual schools (context). Other factors 
included the school's participation in the awareness conferences (15.79%); 
the relevance of the selected innovation to identified needs (15.79%); 
availability of necessary resources (15.79%); and the potential for 
research or dissemination (31.58%). 



Seven factors were identified by school districts in their selection 
of curriculum areas to be included in SHIP. Over two-fifths of the 
districts (42.11%) indicated that their selection was influenced by the 
district's identification of student needs in particular curriculum areas. 
Staff interest and availability contributed to the selection of curriculum 
areas in approximately one-fourth of the districts (26.32%). Other factors 
identified by districts included: original SHIP presentation at the 
awareness conference addressed the selected curriculum area (15.79%); the 
incompleteness of available research in selected curriculum area (5.26%); 
the compatibility of the selected curriculum area with the chosen innova- 
tion (10.53%); and characteristics of the curriculum area organization in 
the selected school (10.53%). 

Four implementation strategies were described in LEA proposals: 

• The lighthouse school strategy, selected by 68.42% of the LEAs, 
focuses implementation in a single school. Success may be broad- 
cast informally and additional schools may elect to adopt the 
innovation, but no formal commitment is made by central office 
staff to actively encourage or train others. 

• The feeder school strategy, selected by two LEAs (10.53%) begins 
with a lighthouse site then expands up through grade levels as the 
initial student population progresses. 

• The capacity building strategy, selected by two LEAs, is essentially 
a staff development approach which encourages voluntary implementa- 
tion following training conducted by staff first involved in SITIP. 

• The pilot/district strategy, selected by two LEAs, involves one or 
a few schools in the first year, with commitment from central 
office staff to become actively involved in dissemination/ implemen- 
tation to many more schools in subsequent years if the the pilot 
sites experience success. 

One LEA did not specify a strategy. In general, plans suggested limited 

scope and intensity of implementation. 
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Evaluation procedures included verification/observation by administra- 
tors (60.42% of the LEAs) and use of standardized tests (63.16%). Other 
techniques included surveys of teaching staff (42.11%), progress update 
meetings or reports (42.11%), surveys of participating students (31.58%), 
teacher-constructed testing of student performance (26.32%), analysis of 
various student indices such as attendance, discipline referrals, or grades 
(15.79%), and parent or community surveys (10.53%). Approximately two- 
thirds of the districts proposing to implement Teaching Variables planned 
to examine changes in time-on- task data. 

In general, the initial local proposals did not appear to reflect 
sufficient understanding of the complexity or particular demands of 
selected innovations to suggest successful implementation. 

Spring planning . In May 1981, fotir planning sessions were held to 
determine the agendas for the summer training institutes: a separate 
planning session was held at the site of its summer institute for each of 
the four innovations. The participant group at each planning session 
consisted of LEA personnel who would be involved in the implementation of 
that particular innovation. LEAs that submitted 3ITIP proposals to imple- 
ment more than one instructional process attended all appropriate planning 
sessions. Planning sessions were directed by MSDE staff that had responsi- 
bility for organizing and directing the summer institutes; the actual SITIP 
training consultants did not attend the planning sessions. 

All four planning sessions followed the same basic four-hour agenda: 
1) LEAs each reviewed their own proposals; 2) MSDE staff reviewed the SITIP 
design, the four innovations and the objectives of the summer institutes; 
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and 3) participants worked in small groups to review their own knowledge 
base and determine content and process needs to be addressed at the summer 
institutes. This information was subsequently shared with consultants 
responsible for the summer training. 

Participants' ratings of the four planning sessions were generally 
positive, providing strong evidence that there was adequate opportunity for 
people to share their concerns about the innovations and to indicate what 
they hoped to gain from the summer institutes. The Mastery Learning 
planning session, in particular, received high ratings while the Teaching 
Variables planning session was not as successful. Participants at all four 
sessions were pleased with the opportunity to share their concerns about 
SITIP. However, except for Mastery Learning participants, they consistently 
rated their understanding of the objectives of the planning sessions prior 
to attending relatively low, suggesting that more communication was needed 
about upcoming SITIP activities. 

Counties generally did not send a team composed of participants as 
recommended by MSDE to the planning sessions. Of the two planning sessions 
for which that kind of participant attendance data were available, only 
four out of thirteen counties sent a team of at least one teacher, a 
principal, and a central office supervisor. 

A cross-tabulation analysis of attendance at awareness conferences and 
planning sessions revealed that generally more than half of those who had 
attended a particular awareness conference had also attended the related 
planning session. Participants of the Active Teaching planning session 
demonstrated the highest incidence of joint participation, as 94% also 
participated in the awareness conference. 
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The major purposes of the planning sessions were accomplished. This 
included developing a list of identifying the concerns, problems, and 
questions of LEA staff related to their selected instructional process in 
order that they be addressed during the summer institutes. 

Fall planning session . In September 1981, MSDE asked representatives 
of the LEA teams to meet to rewrite their original proposals according to a 
common format. Three factors influenced the decision to conduct the 
September meeting: 1) as a result of greater understanding provided by the 
summer institute training, several LEAs decided to revise their plans; 2) 
county office and SEA staff were interested in knowing what each LEA 
planned to do, and wanted information presented systematically and more 
comprehensively than had been done in the initial proposals; and 3) MSDE 
staff assigned as technical assistants (TAs) wanted an opportunity to meet 
and plan with LEA staff for local implementation and follow-up activities. 

The format for the plans was the Promising Educational Practices 
Submittal (PEPS) form designed by MSDE staff involved in Title IVc programs. 
This single page form required basic identification information, and then 
statements relating to: purpose, target population, general description of 
program activities, staff development, evaluation, resources or services 
available to other LEAs, and budget. 

At the fall planning session, following a review of the PEPS form, 
participants divided into groups, each led by two SEA staff assigned as TAs 
for that innovation. Time was then spent refining or revising local plans 
and planning follow-up training and assistance activities. 

Final PEPS forms were subsequently submitted to the SEA, duplicated, 
and distributed to all LEA superintendents. 

ERIC 11 



Although LKAs had been asked to Blind three-person cross-hierarchical 
teams to the fall planning aesslon, moat aent fewer than throe people, and 
several participants had not attended previous events. About half of the 
active tmpleroenters aurveyed In June 1982 had attended the September 
planning session, 54.95% of whom were teachers, 27. 47* school-baaed adminis- 
trators, and 17.58% central office staff* 

APiiJj^JLiJltJL^^ VVA } S forma were ..nalyzed to determine 

the extent to which plana had been refined or revised. Preliminary analysis 
focused on the areas of Information specified on the form: purpose, target 
population, content areas, general program, ataff development, evaluation, 
and dissemination, 

The majority of school districts stated that the SITU* project was 
adopted for the p^rjpose of Improving classroom management and Instruct Ion 
In order to increase student achievement. Of the 19 counties, 14 stated 
explicitly that the purpose was to Impact student achievement. The remaining 
live t.KAs expected to impact teacher behavior to varying degrees through 
ataff development and aimed more for general instructional improvement , 
although student achievement was implied. 

The target population and S}I})Sj^S^S}l n , B tJit ' not change much. Across 
all innovations basic skills subjects were the most common focus: mathe- 
matics selected by ton LKAs, language arts selected by eight, and reading 
by four. Ten counties Included elementary grades (grades 1-5) in their 
plans and 14 Included secondary grades (grades 6-12), with live counties 
including both elementary and secondary grades and five focusing 
exclusively on senior high achool (grades 9-12). 
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The general program descriptions included reference to the innovations 
to be Implemented, Implementation strategies, scope mid intensity. Four of 
the 19 LKAs elected to Implement more thnn one innovation. Of those four, 
two chose to implement three Innovations and two LKAs each choHO to Imple- 
ment two Innovations. Active Teaching wan selected by five LKAs; Mastery 
Learning was selected by six LKAs; Student Team Learning was selected by 
eight LKAs; Teaching Variables was selected by six LKAs, one ot which 
planned to use it In conjunction with Active Teaching and another planned 
to use as a monitoring or back-up system for Mastery Learning, Three LKAs 
decided not to Implement Teaching Variables as originally planned, 

Of the original Implementation strategies, three were retained. The 
"feeder school" strategy was dropped, A fourth strategy — dlst r let -wide 
for all elementary classes — evolved. Selection was as follows: 1) the 
lighthouse strategy was planned for eleven LKAs (two of which used other 
strategies for different Innovations); 2) the pllot/dlst rlct strategy was 
planned for four LKAs (one of which also used the lighthouse strategy for 
another Innovation); \) the capacity building strategy was planned for live 
LKAs (one of which also used the lighthouse strategy); and 4) one LKA 
planned to use the district-wide strategy. 

Planned scope ranged from all (over 400) teachers In all (26) elemen- 
tary schools using an Innovation for mathematics for half the school year, 
to two classes In a single school using an Innovation tor reading for half 
the school year. Where the locus was on staff development as many as 1,000 
teachers were to be offered training with a hope that r )00 would try the 
Innovation sometime over the two-year implementation period, to as few as 
10% of the teachers in one school trained and encouraged to use the innova- 
tion. 
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Tn almost nil cases, plans indicated that LRAh would conduct some 
orientation and lji«e£vlce activities during the 1981-82 school year, 
Kducators who had attended the Hummer Institutes conducted by the SKA were 
designated as turnkey trainers, with teachers or central office staff more 
likely to take the role than principals. 

Descriptions of ^ynluaUon procedures were more specific on the PKPS 
forms than In the original proposals, with almost all LKAs planning to 
measure change In student achievement either through standardized or 
teacher-made tests. Other methods were clarified. Three sites planned to 
use Teaching Variables as an evaluation method. 

In response to Che question of dissemination, most I.KAh stated that 
they would share information with interested others, but much depended on 
the first year's results. 

The PKPS format allowed for greater detail and uniformity among plans 
than had the original format. However, there were stilt differences among 
LKAs in terms of the quality and amount of information provided. The 
greatest weakness related to evaluation 

l)iscitssj()n 

The discussion that follows is based on comparative analysis of 
various data. The following areas are examined: participation, participant 
evaluation of activities initiated by the SKA. comparison of initial 
proposals and PKPS plans, and relationship of planning to training and 
Implement at ion. 
Parti c ijp a tj j) n 

The SKA encouraged LKAs to involve representatives of all three role 
groups (teachers, school administrators, and central office staff) In 
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planning activities,* In all LEAs for all topics, all three role groups 
were involved in planning to some extent. Of the 206 active implementers 
(surveyed June 1982), 65,05% had been involved in at least one planning 
activity. Of the 134 active implementers who had been involved in 
planning, 50.72% were teachers, 20.9% were school administrators, and 
18.66% were central office staff. Involvement in two or more planning 
activities was reported by 44% of the central office staff, 85.71% of the 
school administrators, and 50% of the teachers. 

When data were examined by topic by county, a few instances were found 
where the nature and extent of participation in planning activities was 
such that implementation problems might be anticipated. The seriousness of 
such problems was largely dependent on the nature of the local plan. For 
instance, if an LEA had a pilot/district or district-wide strategy, it was 
more important for all role groups to be involved in planning than if the 
strategy focused on a single school with no intention of expansion to a 
large number of sites. In general, if the LEA intention was for eventual 
implementation (and institutionalization) by many teachers in several 
schools, it was considered necessary for at least one representative of 
each role group to have been involved in at least two of the three planning 
activities. It was preferable for individuals to sustain involvement. The 
discussion below identifies the extent to which representation occurred by 
innovation, then by role. Implications are then reviewed. 



*The three planning activities were: initial proposal development, 
attendance at the spring planning session(s), and attendance at the fall 
planning meeting. 
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• For Active Teaching (AT). 52. I IX of the active implement era 
surveyed were involved in at leant one planning activity. In two 
count ion teacher representation wan inadequate*; In one county 
school admlnlatrators were Insufficiently represented; ami In 
another central oft ice alnff were relatively uninvolvcul. 

• Kor Mastery Learning (MI*) , 62.66Z of the MI, active implemented 
surveyed were involved In planning. Teacher and school admlnlstrn- 
tor representation was inadequate for one I.RA. and central oil lee 
representation was inadequate for two other LKAh. 

• Kor Student Team Learning (STl.) , 7 2 • A I % of the active Implement era 
surveyed were involved in at leant one planning activity, Both 
nelion I administrator and central office representation was Inade- 
quate In two LKAh, and In three other LKAh central nl ! ice repreaen* 
t at (on was Inadequate. 

• For Teaching Variable** (TV), //.//% of the active Implementors wen 
surveyed Involved in at leant one planning activity. Teachers wen 
Inadequately represented In two LKAh, school administrators I mult— 

>qaately represented la another two LKAh, and central oil Ice stall 
Inadequat e I v represented In two LKAa (one nl which also had under- 
representat Ion lor teachers). 

With the exception ol AT (where only \V ol proposal developers wen 

teachers), approximately equal numbers of each role group were Involved In 

proposal development for each topic. Again with the exception ol AT, 

teachers outnumbered other role groups at the spring planning sessions. At 

the tall planning, teachers outnumbered other role groups lor all topics 

except TV. 

Lack ol teacher represent at Ion In planning — lor any topic or Imple 
mentation strategy — required other I.RA staff to spend energy on commu- 
nication and eomml tment-bul Idlng to bring about sueeeanlul Implementation. 
This occurred In four LKAh, one of which needed to do this for two topics. 



^Inadequate " role represented at only one, or none of the planning 
act Iv 1 1 lea. 
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Luck ot school ndtt'trint rat or representation occurred In nix I.KAm In 
three e«8i«« remitting from realignment 8 mul requiring other l,KA stall to 
orient new prtnotpnlH. In one enne, It wsh rotnUvoly un Import nnt hIuco a 
teacher-coordinator provided school londemhtp. In two emien (hoth STI.) 
the burden of Implement at Ion wan placed on teachers, with — In one of the 
two IJ-.Am — training and support the renponslbi 1 1 ty of central office 
tit at I . 

Central office stall were under-represented In nix l,EA a, three ot 
which planned multiple topic Implementation. Two of those I.KAs had light- 
house school strategies requiring little Involvement ol central oil Ice 
stall, am! the third had a lighthouse strategy for one topic and a capacity 
hulldlng Ntrntcgy lor the other, both with school-based coordinators. In 
the other three I.KAs, two had lighthouse strategies with nchoo 1 -based 
coordinators, hut the third had a capacity building design which 
did require central ol lice atalf Involvement. In that count v, low 
participation by that role group in planning predicted some Implementation 
p r oh I cms . 

Oveiall participation patterns (looking at both planning and training 
activities) In the context of local plans. Indicated that eleven I.KAs would 
have no Implementation problems caused by Inappropriate representation. 
Attention to teacher commitment might be needed lor AT In two I.KAs, Ml, la 
one I.KA, and TV in two I.KAn. School administrators In at least one county 
Involved In each Innovation might need Information and encouragement to 
support their teachers. Attention to central office stall Involvement might 
be needed lor STI, In two I.KAh . Only in three counties was participation 
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such that, when combined with factors such as staff reassignment, and 
examined in the context of local plans, problems of implementation would 
put a heavy burden on one particular role group. 
Participant Evaluation of Planning Activities 

Only the spring planning sessions were formally evaluated by partici- 
pants. Overall means (on a five-point scale on six criteria) ranged from 
3,79 (TV) to 4.53 (ML), indicating that, in general, participants considered 
that the session activities satisfactorily met their objectives. The 
weakest point (with the exception of ML) was that participants had not 
fully understood session objectives beforehand. The strongest point was 
that participants felt that they had adequate opportunity to express 
interests and concerns that should be addressed at the summer institutes. 

Data were collected by observation and interviews from participants of 
the fall planning session and central office staff who did not attend but 
were involved in rewriting local plans. In several cases local educators 
considered the task of rewriting, using the PEPS format, a waste of time 
and thought the activity to be political rather than practical. However, 
most people involved in planning recognized that one-page summaries using a 
common format would provide the information requested by LEA superintendents. 
Participants of the fall planning session benefited most from the opportunity 
to clarify their own plans (especially when there had been staff reassign- 
ments) and to share ideas with other LEAs. They also appreciated the 
opportunity to suggest ideas and schedules for follow-up activities. 
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Slncr tlu 1 Information requested and provided In the Initial proposals 
differed from the PKPS proposals, comparisons could only be made In three 
areas: selection of innovations, scope and strategies ot implementation, 
and evaluation procedures. 

Innovations. Four counties made changes from the Initial proposal to 
the PKPS lorm: throe deciding to Implement a Mingle Innovation Instead ol 
a combination Including benching Variables. Another retained Teaching 
Variable** an a support to Mastery Learning. The complicated coding proeo 
dine used to measure t ime«on-tnsk, the time required to make classroom 
ohservat Ions, and the possibility oi negative teacher reactions to the 
observational process were some of the reasons counties decided against 
using the Teaching Variables process. 

Sfope and Intensity. The PKPS plans gave greater depth of inlormatlon 
than did the Initial proposals and In some cases comparisons are difficult. 
However, some general comparisons can be made. 

In curricula there* was much less specificity In the spring than there 
was In the fall. In the former case, 1? LKAs used general terms such as 
basic .skills (4), any or all subjects ( r >). and all basic academic subjects 
(1), while In the hill plans only three hKAs suggested that any/all 
subjects would bo addressed. References to specific subjects increased 
from tin* spring to the fall plans: 

• mil t hemat les ~- from f> to lb 

• language arts — from 4 to 10 

• science/biology — from ') to 6 

• social studies — t rom 1 to 6. 
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Reading, mentioned by four LEAs in the spring, was mentioned by four in the 
fall. Nutrition was dropped, and foreign language and special education 
were added.* 

No changes were made in grade levels selected by nine LEAs. Six LEAs' 
fall plans had fewer grade levels involved than initially, five counties 
eliminating one or more elementary grades and one county going from all 
grades to grades 1-4. Two counties added senior high school grades, and 
one county — for staff development — offered to involve all grade levels 
instead of the initial K-5 planned. 

Strategies . Strategies of implementation were much more clearly 
explained in the PEPS, but only at six sites were strategies actually 
changed. Three counties changed from a lighthouse school strategy to the 
pilot /district strategy which means that if the process is successful in 
the first school, other schools will be actively encouraged by central 
office staff to become involved. Two LEAs changed from a feeder school 
strategy to capacity building in which staff are trained and then conduct 
training for others. One LEA changed from building district capacity to a 
lighthouse school. 

Since the original plans did not give details of scope, little compar- 
ison can be made in terms of instructional time spent on using SITIP. Both 

*It should be noted that for Active Teaching, Mastery Learning, and 
Teaching Variables, developer/presenters advocated use for basic skills. 
Active Teaching presentations focused almost exclusively on mathematics. 
In Mastery Learning, a brief reference was made to science. In all three 
cases, it was stated that the innovations are most appropriate for struc- 
tured curriculum. 
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original and PKPS pinna suggested two y«nr« of Implementation beginning In 
September 1981. 

Kyaluntloii pioroduroB. The majority of counties reduced the number of 
evaluation procedures planned in the PKPS proponnl. Twontv-slx |.«reenl ol 
the counties added new techniques, MX eliminated planned techniques, and 
one |.RA remained unchanged. Verification by principals or supervisors, and 
standardized and l cache r-made tenting remained the moat popular. In 
general, evaluation designs, met hod a and measures were relatively simple In 
both sets of pinna. Moat data collection on Impact wan planned lor the 
.second year of Implementation. 

Relationship of Planning to Training and Impl ement at Ion 

Hy the end of the llrst year ol local Implementation, IdiAs had been 
Involved In the three SKA-inltiated planning activities, three SKA- In Ills! ed 
training activities*, and on-site assistance aa needed provided hv SKA 
,,t -'"' A " 1 (J I.KAM did Implement one or more of the Innovations although 
aome reduced planned acope. The following finding* «re of particular 



Interest : 



At state and local levels plana evolved aa participants gained new 
knowledge. Object Ivea and Implementation strategies (as specified 
in the fall of |<)81) remained constant, but changes were made In 
scope and ae lection ot Innovations. 

Local proposals written after the lour awareness conferences (April 
DHl) did not reflect sufficient undemanding ol the innovations 
to suggest Hucceaaful implementation. 



i sluing included: initial awareness conferencea at which Innovations 
InleoH? CV T| by tto three-day summer institutes to 

indept h tra nlng, and follow-up conferencea to meet specific loal needs 
Some . .As alao sent representatives to n leadership conference on . her 
Rn man™ development presented by Barak Roaenahlne and 
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• -Summaries of plans (revised or clarified) after the Hummer training 
(fall 1981) reflected much greater knowledge of the innovations and 
resource requirements for Implementation. 



• Involvement in planning waft encouraged for all three local role 
groups (teachers, nchool-hul I cling administrators, central office 
staff). There were three key planning activities: proposal 
development, participation in spring planning sessions conducted by 
MSDK, and participation in fall planning sessions (all in 1981). 
Right LKAs involved all three role groups in at least two ol the 
activities for a given innovation: none of those sites experienced 
subsequent communication problems . 

• Low Involvement in planning by central office staff caused problems 
(two LKAs — - school staff discontent) only when there was no common 
understanding of: 1) the Implementation strategy and its implica- 
tions, or 7) leadership responsibility for assisting teachers. 

• Low Involvement In planning by school-based administrators (lour 
sires) caused no apparent problems. (They were kept informed by 
central office staff and teachers.) 

• Low involvement in planning by teachers occurred at five sites, 
with problems (overload and resistance) in two esses where Innova- 
t Ion demands were high and teachers' personal concerns were not 
addressed early enough In implementation. 

• Selection ol innovations was influenced Initially by the perceived 
relationship between an innovation and local interest. As partici- 
pants learned more about tin Innovations some revised selection. 
(Four LKAs eventually dropped Teaching Variables.) The reason lor 
revision was complexity: LKAs were unwilling to Invest the time 
and energy required by such a complex Innovation. 

• Implementation strategies determined by LKAs included: 1) district 
wide (involving all teachers in all elementary schools in one I, MA) , 
J) pilot/district (used oy four LKAs, using an innovation in one or 
a lew schools in the first year with central office commitment for 
involvement to expand In the second year), ')) capacity building 
(encouraging voluntary participation through staff development in 
five LKAs) , and 4) a lighthouse strategy (single school implementa- 
tion with voluntary involvement of others attracted by the "light 
of success," but no direct commitment for central office Involve- 
ment in ten LKAs) . 

• Select: ion of school sites was influenced most by staff interest 
(68% of LKAs gave this reason). Other criteria identified by LKAs 
included: school characteristics (36%) t school staff attendance at 
awareness conferences (15%), relevance of an innovation to school 
need (15%) t availability of resources at school (15%), and potential 
for research at the school (15%). All grade levels and types ot 
schools were involved, with about 75% of them elementary. 




ERIC 



t Reliction ol eurricular area** was influenced by: level ol student 
achievement (4* } %) t Htnff Intercut (26%) , relevance ot Innovat Ion to 
curriculum area (?,()£)• character 1st Ich ot organ Izat ion of curricu- 
lum in selected school (10%), The moat popular curricular areas 
were: read lug/ language arta (17 IiEAh) 9 mathematics (lb I.KAh) , 
science (1? I.KAh) , and aoclal studies (li I.KAh). 

• Scope (number of schools, teachers, amount ol time lor use ol the 
Innovation etc.) wan not clearly del 1 tied Initially, wan clarified 
alter summer training, and modified during Implementation at seven 
.si tea. 

• Scope wan largely determined by the strategy selected, and re! lee ted 
local commitment or felt need. Scope wan Inllucneed by innovation 
complexity* with wider (trope more feasible lor leas complex Innova 

t Ion a , 



• Incremental knowledge building with a Merles ol interactive (raining 
and planning activities helped to build an accurate understanding 

ol the innovation's complexity and potential rewards, and allowed 
revision or ret i newest of plans. 

• During the II rat year, once implementation began the Innovation was 
usually not adapted and the strategy did not change. 

• Changes made during Implementation sometimes reduced scope in oidoi 
to maintain quality without stressing resource al locations. 

The I ladings suggest that designs or plans tor Instructional Improvement 
.iir most likely to be successful 11: 1) participation (ol organizations) 
Is voluutarv, ?) communication is mult i-d linens tonal , 0 planning Is inter- 
act Ive with training, A) training and technical assistance are provided 
dining implementation, r >) "lip service compliance" is not accepted as 
Implementation, 6) adjustments of scope are considered legitimate :uid 
t elate to resources available, and 7) each participant has some degree 1 of 
choice about his or her Involvement (nature or extent) In tin* effort, 
these elements were present In SIT! P. 
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